Aerospace Contrd and Application ›› 2024, Vol. 50 ›› Issue (1): 100-106.doi: 10.3969/j.issn.1674 1579.2024.01.012

Previous Articles    

Target Grasping Based on Kinova Robot Arm and RGBD Camera

  

  • Online:2024-02-26 Published:2024-03-28

Abstract: On orbit service and maintenance is an important development direction of space technology in the future. In orbit services such as fuel refueling, cutting and operating wires, screwing caps, and disassembling valves have the characteristics of light load, close range sensing, precise positioning, and grasping. For these application scenarios, this article uses lightweight robotic arm Kinova and built-in RGBD (red, green, blue, depth) cameras for perception, positioning, grasping, and completing ground verification experiments to provide theoretical support for in orbit services. This article first introduces the research background of the robotic arm grasping system and describes the development platform and its characteristics. Secondly, introduce camera calibration, color camera and depth camera registration principles, and use the TF (transform) tree of ROS (robot operating system) to obtain three dimensional coordinates. A color space image segmentation method based on HSV (Hue, Saturation, Value) is proposed for specific captured objects, for object detection, segmentation, and spatial positioning. Finally, the experimental stage involves the robotic arm completing the target capture process based on the visual positioning results. The effectiveness of combining color space image segmentation methods with depth maps for localization has been demonstrated, providing theoretical validation for in orbit services.

Key words: robot, camera calibration, RGBD camera, HSV

CLC Number: 

  • TP242